# Large-scale speech pre-training

Japanese HuBERT base model trained by rinna Co., Ltd., based on approximately 19,000 hours of Japanese speech corpus ReazonSpeech v1.

HuBERT is a self-supervised speech representation learning model that provides aligned target labels for BERT-like prediction loss through offline clustering steps, suitable for speech recognition, generation, and compression tasks.